Reliability and validity of EMS dispatch code-based categorization of emergency patients for syndromic surveillance.

A retrospective study involving the secondary analysis of public health surveillance records was undertaken to characterize the reliability and validity of an EMS dispatch data-based scheme for assigning emergency patients to surveillance syndromes in relation to two other schemes, one based on hospital ED clinicians\u27 manual categorization according to patients\u27 chief complaint and clinical presentation, and one based on ICD-9 coded hospital ED diagnoses. Comparisons of a sample of individual emergency patients\u27 syndrome assignments according to the EMS versus each of the two hospital categorization schemes were made by matching EMS run records to their corresponding emergency department patient encounter records. This new, linked dataset was analyzed to assess the level of agreement beyond chance between the three possible pairs of syndrome categorization schemes in assigning patients to a respiratory or non-respiratory syndrome and to a gastrointestinal or non-gastrointestinal syndrome. Cohen\u27s kappa statistics were used to measure chance-adjusted agreement between categorization schemes (raters). Z-tests and a chi-square-like test based on the variance of the kappa statistic were used to test the equivalence of kappa coefficients across syndromes, population subgroups and pairs of syndrome assignment schemes. The sensitivity, specificity, predictive value positive and predictive value negative of EMS dispatch and chief complaint-based categorization schemes were also calculated, using the ICD-9-coded ED diagnosis-based categorization scheme as the criterion standard. Comparisons of all performance characteristic (i.e. sensitivity, specificity, predictive value positive and predictive value negative) values were made across categorization schemes and surveillance syndromes to determine whether they were significantly different. The use of EMS dispatch codes for assigning emergency patients to surveillance syndromes was found to have limited but statistically significant reliability in relation to more commonly used syndrome grouping methods based on chief complaints or ICD-9 coded ED diagnoses. The reliability of EMS-based syndrome assignment varied significantly by syndrome, age group and comparison rater. When ICD-9 coded ED diagnosis-based grouping is taken as the criterion standard of syndrome definition, the validity of EMS-based syndrome assignment was limited but comparable to chief complaint-based assignment. The validity of EMS-based syndrome assignment varied significantly by syndrome

Reproducibility in the absence of selective reporting: An illustration from large‐scale brain asymmetry research

The problem of poor reproducibility of scientific findings has received much attention over recent years, in a variety of fields including psychology and neuroscience. The problem has been partly attributed to publication bias and unwanted practices such as p‐hacking. Low statistical power in individual studies is also understood to be an important factor. In a recent multisite collaborative study, we mapped brain anatomical left–right asymmetries for regional measures of surface area and cortical thickness, in 99 MRI datasets from around the world, for a total of over 17,000 participants. In the present study, we revisited these hemispheric effects from the perspective of reproducibility. Within each dataset, we considered that an effect had been reproduced when it matched the meta‐analytic effect from the 98 other datasets, in terms of effect direction and significance threshold. In this sense, the results within each dataset were viewed as coming from separate studies in an “ideal publishing environment,” that is, free from selective reporting and p hacking. We found an average reproducibility rate of 63.2% (SD = 22.9%, min = 22.2%, max = 97.0%). As expected, reproducibility was higher for larger effects and in larger datasets. Reproducibility was not obviously related to the age of participants, scanner field strength, FreeSurfer software version, cortical regional measurement reliability, or regional size. These findings constitute an empirical illustration of reproducibility in the absence of publication bias or p hacking, when assessing realistic biological effects in heterogeneous neuroscience data, and given typically‐used sample sizes

The genetic architecture of the human cerebral cortex

The cerebral cortex underlies our complex cognitive capabilities, yet little is known about the specific genetic loci that influence human cortical structure. To identify genetic variants that affect cortical structure, we conducted a genome-wide association meta-analysis of brain magnetic resonance imaging data from 51,665 individuals. We analyzed the surface area and average thickness of the whole cortex and 34 regions with known functional specializations. We identified 199 significant loci and found significant enrichment for loci influencing total surface area within regulatory elements that are active during prenatal cortical development, supporting the radial unit hypothesis. Loci that affect regional surface area cluster near genes in Wnt signaling pathways, which influence progenitor expansion and areal identity. Variation in cortical structure is genetically correlated with cognitive function, Parkinson's disease, insomnia, depression, neuroticism, and attention deficit hyperactivity disorder

Subcortical volumes across the lifespan: Data from 18,605 healthy individuals aged 3–90 years

Age has a major effect on brain volume. However, the normative studies available are constrained by small sample sizes, restricted age coverage and significant methodological variability. These limitations introduce inconsistencies and may obscure or distort the lifespan trajectories of brain morphometry. In response, we capitalized on the resources of the Enhancing Neuroimaging Genetics through Meta‐Analysis (ENIGMA) Consortium to examine age‐related trajectories inferred from cross‐sectional measures of the ventricles, the basal ganglia (caudate, putamen, pallidum, and nucleus accumbens), the thalamus, hippocampus and amygdala using magnetic resonance imaging data obtained from 18,605 individuals aged 3–90 years. All subcortical structure volumes were at their maximum value early in life. The volume of the basal ganglia showed a monotonic negative association with age thereafter; there was no significant association between age and the volumes of the thalamus, amygdala and the hippocampus (with some degree of decline in thalamus) until the sixth decade of life after which they also showed a steep negative association with age. The lateral ventricles showed continuous enlargement throughout the lifespan. Age was positively associated with inter‐individual variability in the hippocampus and amygdala and the lateral ventricles. These results were robust to potential confounders and could be used to examine the functional significance of deviations from typical age‐related morphometric patterns

Cortical thickness across the lifespan: Data from 17,075 healthy individuals aged 3-90 years

Delineating the association of age and cortical thickness in healthy individuals is critical given the association of cortical thickness with cognition and behavior. Previous research has shown that robust estimates of the association between age and brain morphometry require large‐scale studies. In response, we used cross‐sectional data from 17,075 individuals aged 3–90 years from the Enhancing Neuroimaging Genetics through Meta‐Analysis (ENIGMA) Consortium to infer age‐related changes in cortical thickness. We used fractional polynomial (FP) regression to quantify the association between age and cortical thickness, and we computed normalized growth centiles using the parametric Lambda, Mu, and Sigma method. Interindividual variability was estimated using meta‐analysis and one‐way analysis of variance. For most regions, their highest cortical thickness value was observed in childhood. Age and cortical thickness showed a negative association; the slope was steeper up to the third decade of life and more gradual thereafter; notable exceptions to this general pattern were entorhinal, temporopolar, and anterior cingulate cortices. Interindividual variability was largest in temporal and frontal regions across the lifespan. Age and its FP combinations explained up to 59% variance in cortical thickness. These results may form the basis of further investigation on normative deviation in cortical thickness and its significance for behavioral and cognitive outcomes

Machine Learning for Large-Scale Quality Control of 3D Shape Models in Neuroimaging

As very large studies of complex neuroimaging phenotypes become more common, human quality assessment of MRI-derived data remains one of the last major bottlenecks. Few attempts have so far been made to address this issue with machine learning. In this work, we optimize predictive models of quality for meshes representing deep brain structure shapes. We use standard vertex-wise and global shape features computed homologously across 19 cohorts and over 7500 human-rated subjects, training kernelized Support Vector Machine and Gradient Boosted Decision Trees classifiers to detect meshes of failing quality. Our models generalize across datasets and diseases, reducing human workload by 30-70%, or equivalently hundreds of human rater hours for datasets of comparable size, with recall rates approaching inter-rater reliability

Deep Learning for Quality Control of Subcortical Brain 3D Shape Models

We present several deep learning models for assessing the morphometric delity of deep grey matter region models extracted from brain MRI. We test three dierent convolutional neural net architectures (VGGNet, ResNet and Inception) over 2D maps of geometric features. Further, we present a novel geometry feature augmentation technique based on parametric spherical mapping. Finally, we present an approach for model decision visualization, allowing human raters to see the areas of subcortical shapes most likely to be deemed of failing quality by the machine. Our training data is comprised of 5200 subjects from the ENIGMA Schizophrenia MRI cohorts, and our test dataset contains 1500 subjects from the ENIGMA Major Depressive Disorder cohorts. Our final models reduce human rater time by 46-70%. ResNet outperforms VGGNet and Inception for all of our predictive tasks

Brain Aging in Major Depressive Disorder: Results from the ENIGMA Major Depressive Disorder working group

Background: Major depressive disorder (MDD) is associated with an increased risk of brain atrophy, aging-related diseases, and mortality. We examined potential advanced brain aging in MDD patients, and whether this process is associated with clinical characteristics in a large multi-center international dataset. Methods: We performed a mega-analysis by pooling brain measures derived from T1-weighted MRI scans from 29 samples worldwide. Normative brain aging was estimated by predicting chronological age (10-75 years) from 7 subcortical volumes, 34 cortical thickness and 34 surface area, lateral ventricles and total intracranial volume measures separately in 1,147 male and 1,386 female controls from the ENIGMA MDD working group. The learned model parameters were applied to 1,089 male controls and 1,167 depressed males, and 1,326 female controls and 2,044 depressed females to obtain independent unbiased brain-based age predictions. The difference between predicted brain age and chronological age was calculated to indicate brain predicted age difference (brain-PAD). Findings: On average, MDD patients showed a higher brain-PAD of +0.90 (SE 0.21) years (Cohen's d=0.12, 95% CI 0.06-0.17) compared to controls. Relative to controls, first-episode and currently depressed patients showed higher brain-PAD (+1.2 [0.3] years), and the largest effect was observed in those with late-onset depression (+1.7 [0.7] years). In addition, higher brain-PAD was associated with higher self-reported depressive symptomatology (b=0.05, p=0.004). Interpretation: This highly powered collaborative effort showed subtle patterns of abnormal structural brain aging in MDD. Substantial within-group variance and overlap between groups were observed. Longitudinal studies of MDD and somatic health outcomes are needed to further assess the predictive value of these brain-PAD estimates

Virtual Ontogeny of Cortical Growth Preceding Mental Illness

Background: Morphology of the human cerebral cortex differs across psychiatric disorders, with neurobiology and developmental origins mostly undetermined. Deviations in the tangential growth of the cerebral cortex during pre/perinatal periods may be reflected in individual variations in cortical surface area later in life. Methods: Interregional profiles of group differences in surface area between cases and controls were generated using T1-weighted magnetic resonance imaging from 27,359 individuals including those with attention-deficit/hyperactivity disorder, autism spectrum disorder, bipolar disorder, major depressive disorder, schizophrenia, and high general psychopathology (through the Child Behavior Checklist). Similarity of interregional profiles of group differences in surface area and prenatal cell-specific gene expression was assessed. Results: Across the 11 cortical regions, group differences in cortical area for attention-deficit/hyperactivity disorder, schizophrenia, and Child Behavior Checklist were dominant in multimodal association cortices. The same interregional profiles were also associated with interregional profiles of (prenatal) gene expression specific to proliferative cells, namely radial glia and intermediate progenitor cells (greater expression, larger difference), as well as differentiated cells, namely excitatory neurons and endothelial and mural cells (greater expression, smaller difference). Finally, these cell types were implicated in known pre/perinatal risk factors for psychosis. Genes coexpressed with radial glia were enriched with genes implicated in congenital abnormalities, birth weight, hypoxia, and starvation. Genes coexpressed with endothelial and mural genes were enriched with genes associated with maternal hypertension and preterm birth. Conclusions: Our findings support a neurodevelopmental model of vulnerability to mental illness whereby prenatal risk factors acting through cell-specific processes lead to deviations from typical brain development during pregnancy